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ABSTRACT 

A group s.uppor t i ve testing procedure and 
acculturation level are investigated as to their influence upon 
achievement test scores of 150 culturally diverse inner city school 
students in grades four through six. The group supportive testing 
procedure was specifically designed as a facilitation strategy that 
attempted to mirror the more typical interaction style of minority 
children. The multidimensional measure of acculturation sought to 
elucidate whether students with particular acculturation profiles 
would present a particular test-taking performance,, The experimental 
facilitative procedure employed did not improve either the Anglo or 
Mexican Amer icgn% chi ldren 1 s test performance. The author? state (1) 
that minority group children should be administered group achievement 
tests under standard administration procedures, and (2) a student's 
sociocultural status, at least socioeconomic status and family size, 
appears to be a patent ially relevant psychological construct that 
warrants further attention. (PN) 
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ABSTRACT OF RESEARCH PROJECT 
Introduction 

Policy planners , educators , and test developers are ^ 
aTl faced with increasing reports of the misuse of standard- 
ized tests. Mercer (1971) first pointed out that a dispro- 
portionately higher number of Black and Mexican American 
students were being labeled as mentally retarded, based 
solely on low intelligence test scores that have been shown 
to be biased against minority children. It is logical 
to assume that a similar phenomenon may be occurring among 
minority children on achievement tests (i,e,, standardized 
achievement tests may not be accurately measuring culturally 
diverse students' full knowledge of academic material, 
due to biasing influences ) , 

Klineberg (1935) pioneered exploring extra-test factors 
that affect attainment level, and found that socioeconomic 
status (SES), language, amount of schooling, and motivation 
all influenced Black children's test scores. Cole and 
Bruner (1971) carefully reviewed^a tremendously large number 
of studies on minority group test performance, and concluded 
that the evidence does not support a deficit model. Rather, 
they hypothesized that the tests themselves, and the testing 
procedures employed, may not be permitting elicitation 
of minority children's full potential, Bernal (1977) stated 
that there is "something about the test(^) or testing situati 
which affects how minority subjects perform," and suggested 
that language proficiency, SES, testwiseness , motivation, 
and degree of acculturation all impact upon the testee, 

Pfeiffer (1982) most recently reaffirmed that all 
higher psychological processes are shaped by our culturally 
organized experiences. By implication, we can postulate 
that achievement testa are inevitable cultural devices, 
influenced not only by their psychometric qualities, but 
also by the individual's particular attitudes, values, 
perceptions , mot i vat ion level , and distinctive sociocultural- 
behavioral patterns, 

A number of writers have speculated that minority 
group children are forced to perform on standardized tests 
in a manner inconsistent with their sociocultural experience 
(e,g,, Bernal, 1977; Cole & Bruner, 1971; Gay & Abrahams, 
1973), Gay and Abrahams (1973) contend that "it is not 
the questions per se 1 which cause Black children difficulty, 
it is the testing environment in general and especially 
the techniques that are used to ask' the questions.." These 



writers hypothesize that the "Anglo-oriented" testing situa- 
tion does not match the typical interactional style of 
minority cultural groups, where informality and cooperation 
dominate, Ramirez, Castanedo and Herold (1974) add empirical 
support for distinct interactional styles among culturally 
diverse children, showing that Mexican American families 
are characterized by child rearing practices which foster 
a field dependent socialization style. 

Recently, researchers have begun to explore differences 
not only between a particular ethnic group and the Anglo 
core (or host) culture, but also to look at differences 
within the ethnic groups. The belief that ethnic groups 
are heterogeneous, and that labeling a person as simply 
Anglo, Black, Hispanic, or Native American oversimplifies 
the rich and varied sociocul tural fabric existing among 
all individuals, led Pfeiffer and Naglieri (1980) to develop 
a multidimensional measure of acculturation. Their instru- 
ment (PNA) plots the individual on a number of dimensions 
which include language preference and usage, cultural identi- 
fication and preference, ethnicity, interethnic distance 
and interaction, SES, family structure and size, and urban 
assimilation. As Berry (1980), Olmedo (1979), Olmed© and 
Padilla (1978),. Padilla (1980), and Pfeiffer and Naglieri 
(1980) all point out, accultur at ive linguistic, psychological, 
and sociocultural factors must all be considered in under- 
standing how the person fit$ both within his own and the 
host culture. And this understanding of each individuals 
acculturation level should help explain how culture differen- 
tially influences scholastic and test-taking performance. 

Purpose of the Study 

The purpose of this stydy was twofold: to investigate 
whether a group supportive testing procedure and accul tura- 
tion level will influence the achievement test scores of 
culturally diverse students. The group supportive testing 
procedure was specifically designed as a facilitation strategy 
that attempted to mirror the more typical interaction style 
of minority children. And the multidimensional measure 
of acculturation sought to elucidate whether students with 
particular acculturation profiles would present a particular 
test-taking performance. 

If a specific ethnic group, or a group of individuals 
within any one ethnic group which presents a particular 
acculturation profile, score significantly higher with 
the group supportive testing procedure, then one can conclude 
that the standard testing procedure does not permit an 
equitable demonstration of each student's maximal knowledge. 
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RESEARCH SITE 



This research project was conducted during April, 
1982. Wilson School District and Murphy School restrict, 
both inner-city school systems in the Phoenix area, were 
selected as the two sites of the research. Approximately 
150 students, grades fourth through sixth, participated 
in the project . 

TEST RESULTS 

As , discussed earlier, this project explored two main 
research quest ions : 1 ) whether a group support i ve test ing 
procedure would f aci 1 i tate the achi evement test performance 
of culturally diverse elementary grade students, and 2) 
if acculturation status plays a significant role in a students 
achievement test score. 

The numbers of children o£ each racial group and grade 
are presented in Table 1. Examination of these data reveals 
that there were similar numbers of children of each racial 
group in each grade. A nonsignificant (p>0.10) chi 3quare 
of 7.82 (4 df) was obtained indicating that the three grades 
could be combined for subsequent data analyses . Since 
only five black students participated in the study, these 
children were excluded from subsequent analyses. 

A description of the Mexican American and Anglo groups 
is presented in Table 2. Examination of this table reveals 
that the Anglo and Mexican American samples were quite 
similar with respect to age. There was only a 1.9 month 
difference between the means, the SDs are very similar, 
as were the ranges. The ratio of males to females was 
about 40/60 in the Anglo and 50/50 in the Mexican American 
samples. The greatest difference between the samples appears 
to be in the Schools attended. Nearly 50% of the Mexican 
/.American sample came from school #4 while none of the Anglo 
sample attended this school. However, due to the similarity 
of schools within the* district , this disparity is viewed 
as having little impact. 

Table 3 presents^reading vocabulary scores for the 
two groups under the standard and experimental conditions. 
Examination of these scores reveals that the Mexican American 
students scored somewhat lower than the Anglo students 
in the standard reading vocabulary test condition, while 
they outperformed the Anglos in the experimental condition — 
however, both group mean scores were lower under the group 
faci 1 i tati ve experimental condition.. Repeated measures 
ANOVA results yielded a significnt F ratio for group (F=ll . 75, 
P'0.001) and group by condition interaction (F=18.41, p <' 0.001). 
Analyses of simple main effects were used to compare the 
four mean scores. These analyses uncovered only two compari- 
sons that were significant: a) the Mexican American qroup 
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mean was significantly higher than the Anglo students 1 
mean score during the experimental condition (F=78.91, 
£<0.001) and b) the Anglo students' mean score was signifi- 
cantly higher under the standard than experimental administra- 
tion procedure (£=32.70), £<0.001). Hence, these analyses 
indicate that the Anglo students' mean performance decreased 
significantly from the standard^ to experimental administra- 
tions, while the Mexican American childrens' mean decline 
was slight and nonsignificant. Additionally, the Anglo 9 
group mean was significantly lower than the Mexican American 
group mean under the facilitative condition. 

The data presented in Table 3 yield the following 
conclusions : 1 ) neither group benefitted from the group 
facilitative (experimental) administration; 2) the Mexican 
American children performed much better than the Anglo children 
in the experimental condition, but about equal in the Standard 
condition; 3) both the Anglo and Mexican American samples 
evidenced 'substantially greater variability in their scores 
under the experimental procedure (note SDs two to three 
times larger in the experimental as opposed to standard 
condi t i on3 ) . 

The increased variability in the distribution of reading 
vocabulary standard and experimental standard scores for 
the Anglo and Mexican American groups i3 graphi cal ly . i 1 lust ra- 
ted in Figures 1 and 2, respectively. Examination of Figure 1 
reveals that the distribution of reading vocabulary scores 
under the standard condition was rather normal in shape 
(akewn^oa 0.24; kurtosis= -0,084) while the distribution 
of reading vocabulary scores under the experimental condition 
was not normal (skewness- -0,43; kurtosis- -1,6), As is 
evident by examination of Figure 1, the distribution of 
scores inline experimental condition is rather bi -modal. 
Mo reovervrwTfT^^ considerable difference between the Anglo 
group reading vocabulary experimental and standard conditions 
moans exists (461, 335), there is a less dramatic difference 
between the medians (467, 423), suggesting that the difference 
was greatly influenced by some very low scores. 

Figure 2 graphically represents the distribution of 
reading vocabulary scores under both conditions for the 
Mexican American group. Similar to the Anglo group's distri- 
bution, the o co res under the standard condi t ion were rather 
evently distributed (skewness** 0.35; kurtosi3=- -0.42) while 
under the experimental condition the scores were more bi-modal 

(skewnesss -2.21; kurtosis" 5.55). Additionally, differences 
betgween mean and median scores for this aamplo reveal 
a similar pattern seen in the Anglo sample. The Mexican 
American group means differed by about 15 points but the 
medians did not — — thoy wore identical (452) • Once again, 
this illustrates that the interpretation of the difference 
in mean scores in somewhat misleading due to the influence 

of a few very low scores. 
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Examination of the percentage of children who scored 
extremely low under the experimental (group-f acili tative ) 
condition revealed that the Anglo and Mexican American 
samples differed in this respect. That ia, 7% of . the Mexican 
American sample as opposed to 36% of the Anglo sample earned 
scores leas than 300 in the experimental condition. It 
is this shifting of scores which is responsible for the 
di f f erences in means versus medians , the large standard 
deviation in the Mexican American, and the very large standard 
deviation for the Anglo group's reading vocabulary experi- 
mental conditions . 

Examination of the correlational relationship between 
the reading vocabulary standard and experimental conditions 
with the California total reading test standard scores 
was examined for the group as a whole (n=138) to further 
understand what the reading vocabulary tests in the standard 
and experimental conditions were reflecting. The reading 
vocabulary (standard) correlated 0.8575 (jk 0.001) with 
the total reading score while the experimental reading 
vocabulary scores correlated 0.163 (£ 0.05) with total 
reading. (Reading vocabulary standard and experimental 
conditions correlated 0.018, g><0.10). The significance 
of the difference between the reading vocabulary experimental/total 
reading nnd reading vocabulary standard/total reading co- 
officiento waa tested using a t-test for the difference 
between correlated correlations. This test yielded a t \ 
valve of 11.69 (p- 0.001) which indicates that the difference 
reflected a real disparity in correlations. Hence, the\ ] 
reading vocabulary exper imental/ condi t ion was influencedNJ 
by some variable other than overall reading prof iciencv^y 
in contrast to the standard ■ reading vocabulary condition/ 
which correlated as expected with total reading. Si^il^rly, 
the reading vocabulary (standard) correlated significantly 
with the total grammar standard score (0.511, £<0.0001) 
while the reading vocabulary experimental test condition 
correlated 0.083 (jr>0.10) with grammar total. The differnce 
between those correlation coefficients was also significant 
(t°4.13, g-0.001). These findings suggest that the reading 
vocabulary test administered under the standard conditions 
was essentially functioning as intended, to measure English 
vocabulary proficiency. In contrast, the reading vocabulary 
te3t admin i stered under the exper imental cohdi t ion did 
not correlate nearly as well with the reading total or 
grammar total as such a te3t would be expected to, and 
is likely reflecting some other variable other than vocabu- 
lary skill . 7 



Correlations among the System of Multicultural Pluralistic 
Assessment (SOMPA) acculturation 3caTe3 and the Reading 
Vocabulary Scores earned under Standard and Experimental 
Scores earned under Standard and Experimental conditions 
are presented in Table 4. Examination of these coefficients 
reveals that the SOMPA sociocult ural subtests designed 



to assess acculturation status did not correlate significant- 
ly with the reading vocabulary scores under the standard 
condition and only two of the four variables (socioeconomic 
status and family size) correlated significantly under 
the experimental condition.* the only significant correla- 
tions were reading vocabulary experimental with family 
size and socioeconomic status. Since family size and socio- 
economic status correlated 0.38 (£<0.0001), these two subtest 
scores (variables) should probably be viewed as reflecting 
a strong relationship between the reading vocabulary experi- 
mental scores with general family socioeconomic conditions. 
This suggests that performance on the Reading Vocabulary 
experimental task was significantly related to a child's 
level of family social and economic status. Additionally, 
the lack of significant correlations between the SOMPA 
subtests and reading vocabulary scores obtained under the 
Standard condition suggests that a child's socioeconomic 
level was differentially related to achievement test scores. 

The fact that the group facilitative (experimental) 
administration procedure did not enhance the achievement 
test scores of the Mexican American children can be explained 
in a number of possible ways. One, the group facilitative. 
procedure may not have accurately or realistically mirrored 
the more typical interaction style of culturally different 
children. Two, the experimental condition may not have 
been a powerful enough faci 1 i tat i v e intervention strategy" 
to create the testing ambience that Bernal (1983) suggests 
leads to "improved performance of minority students in 
(with) an appropriate facilitative intervention virtually 
eliminating initial racial and ethnic differences" (p. 9-10). 

A third possible explanation for the ineffectiveness 
of the experimental condition is that a single "score-enhancing 
technique" may not be significant enough alone to produce 
higher average achievement test scores. Jensen's (1980) 
exhaustive review of the research literature on external 
sources of test bias (i.e., test sophistication, motivation, 
attitude, personality, expectations, dialect, race and 
sex of the examiner, indi vidual-vs . -group* administration, 
and times vs. untimed) concluded that "no variables in 
the test situation, but extraneous to the tests, have been 
identified that contribute significantly to the observed 
average test score differences between social classes and 
racial groups" (p 618). It may be that future research 
will have to look at test bias in a more complex, interactive 
manner; with researchers modifying conjointly a number 
of hypothesized facilitative factors such as small group 
administration , rapport building between examiner and children, 
practice" ] feedback to chi ldren regarding the accuracy of 
their responses , and a more relaxed i nteract ional testing 
procedure . It may take three or four of these factors 
in concert to produce significant improvement in achievement 
test scores of minority group children. 

7 
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The 1 present research offers two clear implications 
for educational practice. First, minority group children 
should be administered group achievement tests under standard 
administration procedures. The experimental facilitative 
procedure employed in the present study did not improve 
either the Anglo or Mexican American children's test perfor- 
mance, and any modification in standard administration * 
should be conducted in a highly tentative, cautious, and 
judicious manner. 

Second, a student's sociocult ural status, at least M 
socioeconomic status and family size, appears to be a poten- 
tially relevant psychological construct that warrants more 
attention by both researchers and practitioners. Future 
refinements in the measurement of sociocul tural status 
would appear to help educators better understand a minority 
group student's attitude, motivation, expectancy, and level 
of anxiety when approaching standardized achievement (and 
aptitude) tests. 
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TABLE 1 

Number of Children" of Each Racial Group 
and Grade (N=138) 



Race 



Grade 



Row Total 



6 



Whi te 



N=13 



N=19 



N=7 



N=39 



Hispanic 



N=41 



>7=24 



N=29 



N=94 



Black 



M= 3 



N= 1 



N= 1 



N=5 



Column total N«57 



M=44 



N=37 'Total N=138 
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TABLE 2 

Descriptive Statistics of Anglo and 
Mexican American Samples 



Variable 

Age in months x 
SD 
Range 



Sex 



Males 
Females 



Anglo (N=39) 
132.8 
11.7 
112-161 

38. 5% 
61 . 5% 



Mexican American (N-94) 
134.7 
12.1 
112-172 

47.9% 
52.1% 



School attended 



#1 
#2 
#3 
#4 



76.9% 
17.9% 
5.1% 
0.0% 



30.9% 
14.9% 
16.0% 
47.9% 




TABLE 3 



Means and SDs "for Anglo and Mexican American Groups 



Groups Reading Vocabulary Conditions 

Standard / Experimental 

Mexican American (N=94) 

Mean 451.8 436.4 

* SD 49.5 100.6 



Anglo (N=39 x 

Mean .461.5 335.4 

SD *48.3 179.5 



) 
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TABLE 4 • 
Correlations Among the SOMPA 
and Reading Vocabulary Scores 



SOMPA Reading Vocabulary 



Subtests 


Standard Condition 


4 

Experimental Condition 


Family size 


0.01 


0.22* 


Family structure 


0.10 


-0.08 


Socioeconomic status 


0.02 


- 0.23* 


Urbal acculturation 


0.02 


0.15 



^Correlations are significant at an experiment-wise error rate of 
» 0.006 level of probability need for significance of 

the Pearson product -moment correlation] . 
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Figure 1 

Distribution of Anglo Reading Vocabulary Standard and 



Experimental Conditions (N=39) 
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Figure 2 

Distribution of Mexican American Reading Vocabulary 
Standard and Experimental Conditions (N=94) 
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Administration Directions ; 

Each group of student's is to work independently on the 
Reading Vocabulary (RV) subtest of the California Achievement 
Test (CAT). Within ^ach group, one student will be given 
the task of answering each of the RV questions. The remain-, 
ing two students will be encouraged to support, encourage, 
and help this student complete the task, NOT choose the 
correct answer. At no time are either of the two "supportive" 
students to influence the selection of the correct answer. 
Comments such as, "You're doing good," or "Great job," 
are appropriate; not "B is the answer." 

Directions to Students : 

SAY: "Please form into groups of three. * 

■ *•> 

"What we are about to do is an important part of an 
experiment being conducted by Northern Arizona University. 
Please follow these directions carefully. In each group 
of students, one person has been chosen to answer 30 vocabulary 
questions. I will hand these out in. a few moments.* This 
person is to answer each question completely on his or 
her own. The other two students are NOT allowed to help 
this person in choosing the correct answer. Instead, the 
two other students should encourage and support the student 
answering the questions. so, you can say, 'You're doing 
good, 1 or 'Good job,' or £Reader may interject appropriate, 
perhaps humorous, words of encouragement Jj , but not 'B 
is the correct answer.' [Pause ^ Any questions? 

"Now, liere is the anlswer sheet. Before we begin, 
please fill in your name, grade, and teacher's name; please 
write clearly on your answer sheet. 

"I will read the directions; please follow along. 
Follow directions through the sample item C. 

"If there are no questions, we will begin. 

"Remember, you can help the student completing the 
test by encouraging him, but DO NOT TELL THE ANSWER." 

Follow directions on page 22 — START. 
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Figure 4 
Child Acculturation Scale 

(1) Name j ID Number 

(2) Ethnic Background: 

Anglo/White 

Mexican American 

Black 

Native American 

Other 

( 3 ) Sex: Male Female 



(4) How religious would you say your family is? 



1 5 3 3 ~ 5 

not religious moderately very 

at all religious religious 

(5) How important do your parent (s) think doing well in 
school is? 



2 3 — T~ — 5 

not very moderately ^ very 

important important important 

(6) How much do you care about getting good grades in school? 



7~ 3~ T~ 5 

not at all somewhat a great deal 

(7) How much schooling would you like to complete? 

Junior high 

High school 

Vocational/Technical 

College \ 

Graduate school (doctor , lawyer, PhD, etc. ) 

17 

lo 
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(8) How much schooling do you think your parent (s) want you 
to have? 



Junior high 
High school 



Vocational/Technical 

College 

Graduate school (doctor, lawyer, PhD, etc.) 



(9) What language is spoken at home' by your family? 

English only 

Mostly English 



Spanish only (Navajo, Hopi , etc.) 



Mostly Spanish (Navajo, Hopit, etc) 



1 

X 



T 
T 



(10) How would you like the following things in your life to be? 

Completely Mostly Both Mostly Completely 

Mexican- Mexican- Mexican- American American 
American American American 
(Native (Native (Native 

American ) American ) American ) 

and 

Amer i can 



Food 

Language 
Music 

T.V. Programs 
Books/Magazines 
Radio Programs 



3 

T 



T 



5 

T 



Ways of Celebrating 
Holidays and 
Special Events 
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